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Medical image fusion can help the physicians to extract the features that may not 
be normally visible in images by different modalities. In this paper, propose an 
efficient fusion method based on cross scale fusion rule. The performance of the 
propose method can be verified by objective evaluation metrics i.e. Q^^^ . 



INTRODUCTION & MOTIVATION 

Image fusion is the process of integrating two different modalities to form a single 
modality. Image fusion is playing a crucial role in medical imaging remote 
sensing, computer vision , robotics etc. image fusion can be categorized into three 
levels (1) data level (2) attribute level (3) symbol level. Though image fusion can 
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be used in many areas like remote sensing & astronomy. Applications like remote 
sensing & astronomy use multisensory fusion to achieve high spatial and high 
spectral resolutions by combining the two modalities , one having higher spatial 
resolutions and other having higher spectral resolution. There are numerous 
applications that have appeared in medical imaging like simultaneous evaluation of 
CT, MRI & PET images. In medical field pixel level is regarded as 
computationally efficient. Medical image fusion is hot topic of research now days. 
Lot of research has been conducted on medical image fusion in the last decade, but 
still there is scope in the coming years. Multisensory fusion have large applications 
in military security and surveillance areas. In multiview fusion a set of images of 
same scence taken by the same sensor but from different view points is fused to 
obtain an image with higher resolution . Beside multi sensor & multi view there are 
other types of fusion strategies that are well explained in [5]. 

LITERATURE SURVEY 

Since it is well known that lot of efficient & effective techniques have been 
proposed during the last ten years. But it is better to consider the most recent 
techniques during the last 4-5 years. In 2011, multi focus image fusion technique 
based on bilateral gradient sharpness criterion is proposed by Jing Tian & his co 
researchers [1]. In 2012, Jian Tian & Li chen proposed a multi focus image fusion 
method based on wavelet statistical sharpness measure [2]. In 2013,fusion 
techniques using cross bilateral filter is proposed by B.K. Shreyamsha kumar[3]. 
But a most revolutionary image fusion method based on cross scale coefficient 
selection is proposed by Rui shen and his co researchers in 2013 [4] & claims that 
his proposed method is efficient than the existing one. 

RESEARCH GAPS &FUTURE SCOPE 

In paper [4], Dr. Rui shen and his fellow research workers claims that there is no 
formation of artifacts in the fused results. Formation of artifacts can not be fully 
avoided but it can be reduced. Amount of formation of artifacts can be calculated 
by objective evaluation metrics where as author does not done any such evaluation. 
Secondly the author does not evaluate the loss of information from source images 
to fused images. These are the mere drawbacks that I would like to investigate in 
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future research work and like to go for the future enhancement of the cross scale 
fusion rule . 





MSD 




Figure 1-MSD based fusion[4] 

First the source images are decomposed to multi scale representations using multi 
resolution decomposition to various levels. MSR is low resolution pyramidal 
structure contains one approximation level and several detail levels. 
Approximation level stores low pass coefficients and DET stores high pass 
coefficients. Then a proposed cross scale fusion rule is applied to different 
coefficients and finally get the resultant synthesized image by applying inverse 
MSD. 

OBJECTIVE OF THIS PAPER 

.(1) To re -implement the cross scale fusion rule proposed by Dr. Rui shen. and 
propose a novel techniques of image fusion. 

WORK DONE 

We have taken one data set of PET & MRI images. Then decomposed these source 
images to 3 levels by MSD(DWT). Then imply the Gaussian & Butterworth band 
pass filtering of mid frequencies but prefer the Gaussian band pass filter as it avoid 
ringing effects that lead to formation of artifacts. Then activity level measurement 
is done by CBA (coefficient based activity) for DET of source images. Then 
compute the member ship by using zero gauss member ship function as input and 
compute the output the triangular membership function for coefficients selection. 
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If Ix = OJy = 0 then select low pass coefficient i.e. APX. If Ix ^ 0,Iy^O then select 
high pass coefficients i.e. DET. So as a conclusion we have to select both high pass 
& low pass coefficients. Firstly select the low pass coefficient for fusion. Fused the 
different levels of APX of first source images to another APX of second source 
images and get the final fused images. 




PET IMAGE MRI IMAGE 




MULTIRESOLUTION DECOMPOSITION BY DWT FOR MRI (V' ,2 & 3 

LEVEL) 




MULTIRESOLUTION DECOMPOSITION BY DWT FOR PET (r\T'' ,& 3 

LEVEL) 
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GAUSSIAN BAND PASS FILTERING FOR MRI APX( 1^^ ,2^° & 3™ LEVEL ) 



Q 
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BUTTERWORTH BAND PASS FILETRING FOR MRI APX(1^^,2^°&3^° 



LEVEL) 








GAUSSIAN BAND PASS FILTERING FOR PET APX( 1^^ ,2^° & 3^^ LEVEL ) 
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BUTTERWORTH BAND PASS FILETRING FOR PET APX(1^^,2^°&3'^° 

LEVEL) 
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ACTIVITY LEVEL MEASURMENT BY 
CBA FOR DET (PET) 



CALCULATION OF CORRELATION COFFICIENT OF IMAGE WITH MEDIAN 
FILTER 
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MEMBERSHIP FUNCTION FOR MRI 
,PET(APX-1ST2N°AND3''°LEVEL) 
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• IF Ix =0, ly= 0 then select low coefficient i.e. APX 

• IF Ix not equal to 0 ,ly not equal to 0, then select high coefficient i.e. DET 



ACTIVITY LEVEL MEASURMENT BY 
CBA FOR DET (MRI) 



CALCULATION OF CORRELATION COFFICIENT OF IMAGE WITH MEDIAN 
FILTER 
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MEMBERSHIP FUNCTION FOR MRI 
,PET (DET-lST 3'^'' LEVEL) 
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• IF Ix =0, ly= 0 then select low coefficient i.e. APX 

• IF Ix not equal to 0 ,ly not equal to 0, then select high coefficient i.e. 
DET 

FUSING APX 3RD LEVEL MRI TO APX 
3RD LEVEL PET 



FUSING APX LEVEL MRI TO APX I^t 
LEVEL PET 



MRI APX 1^' LEVEL 



PET APX 1" LEVEL FUSED IMAGE 



FUSING APX 2ND LEVEL MRI TO APX 
2ND LEVEL PET 



• IVIRIAPX2NDLEVEL PET APX 2ND LEVEL ci icrn l^fli^^F ' MRI APX 3"° LEVEL PET APX 3"° LEVEL FUSED IMAGE 
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OBJECTIVE PERFORMANCE 
EVALUATION 



LEVELS 


QAB/F 


MRI PET(1*T LEVEL] 


0.7261 


MRI PET (2"» LEVEL) 


0.6342 


MRI PET (3«» LEVEL) 


0.7702 



CONCLUSION 

Q^^^ value is almost close to base paper[4]. But there is no control over the 
formation of artifacts. Formation of artifacts induces distortions and noise in the 
fused images. It is serious matter to avoid for the upcoming steps. 
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